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[0005] Cmi] 

Y^ailog-^ ...(1) 

[0006] rr-c\ a, b (i=i, L) it^ti^tim. ^2KMfii:^ir^^m<Dmm.mm^m'r^ 

i i 

a +a +-"+a =1, b +b +-+b =1 ^mtlir^ U-iA^'T^^h<DmMWC'Ch 

12 L 12 L 

■So 

[0007] _h-efi#ic. ^^(Dmn\'m^m^(Dmm(Dmmm&:^^h$Y^ir^. v^t?*^^^^ 

M.&i^fl^tl^^^^^'7Mgcam, h^^iJ^'^Atrigram, n-gram)^#X.Tt)J;V\ feSV^ 
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Conference on Research and Advanced Technology for Digital Libraries, 2000)j (Jt 
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^•T^K-v^i5^-^/v-::^nir^;/v'>-i^'98, 333— 336M. irAn>"ftb.. tKii^ 

y^y^'y-^^ (Yamron et al.. Hidden Markov model approach to text Segmentation and 
event tracking, Proceedings of International Conference on Acoustic, Speech and 
Signal Processing 98, Vol.1, pp.333-336, 1998)j (JCfi^S) ^CfB^;05fe^j;5^<^^ T^:^ 
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[0012] m2(DmM^mxi^. ^m(D^v'/v^i'ff^ir^fcmz.^ mm{^^m.m^^T^^h^ 

[0013] ;$:^K<^ g mM^^i^i&=^:^h^^-Dmmmi^'T^:^hxm^mm:::tK^m\ 
. xm^mm:::tK^mx^^x^K'r^^tKh^o 

[0014] _hfB g m^mf^-r^fcmc^ *^0J(^7^^:^hMa;^?i{*. 7^^:^hJc»^«fi^i- 

;5#>srO^M^S^^(Z)|SM(-Mi-Sj6^^^tb^^ (Latent variable) tC, #>Er OD^M^ 
(Observable variable) ^cl^^^^tl.>i^i■^£^#^tfc^^^T'/^^^^i-§:^7^5' 
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[0015] ^fc. :^mM(DT^:p^hmmmm:i-i. T^:^hxm^mmir^^^ (Dmm^^t^(D^ 
[0016] ^^mmi^xM. mmMM<DT^:^hxm<Di^MK}^^\:'X^<'7^—i^^mi^ir^^ 

[0017] [Eli]giu*. ;^^5a<^— ^ife^!lt-#^7^^^h^a^g(^«fiK^^-r:7^n:y:^^|2|-e 
[EI3]E13{*. mti-^/i-=^:^^'f/^y^Mmir^tcbbcomitMXh^o 

[1114] iii4(*, m (Dm(7)mMm i^^^'T^:^hmmmw:<7)mi^^^iry^^^y^m 
x-h^o 

m5mm.'mi<D^^^m^^mnir^fz.)^<DWL-^Mx^:6o 
[Bi6]gi6«, m2(D%mi^m'kmm^^fz.^(DWL^Mx^^o 

[0018] mi(D'Mmm 
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104t.^T^/W<9?^—^:^m^t^l04iZX^Xl^mit:^^tc.^v'^/Pt'T^::^hmW.^ 

102 iz:^m^tifdT^y^h:icm^^'oX^ ^(D^f;V(D^'f/v^<=7:^—^^mM'r^ 

^t'Vw-?^^— i5^*i^g|5105^. ^•t'Vw-?^^— ^^i^§|5105;05fi^ofc^-?9^— 

<Z)»^m^*&lfti-§tifel^;i:tE'll§P106^. ti^|^;^fBllt|S106iilSm(D^T^Vk(D/-^ 

y}^—^mW^^ti^^Mi^fhX\ ^^m^K^<D 4id^^>lo(D^y^VKD^^9p<— iS^Ji^ 

^mmi^^^^hAtjT^:^hxm(D^m^n<^xi^^^m:fjir^T^:^h^mi^^ 

[0020] ^^x-y'^y^hxmti'i^ _h^bfcj;5 f-. m^i^^. m^y^^y^^m(Dmmmm^m 
K^m^^tifc^\^tix^m^^^^x^mmmmiocR)xm^^<^fci^^^. 

[0021] ^ic. ^mmm<D'r^::^vmmmm:(DWi^^. m2^^m\^xnm\mm^^o 
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1 2 T 

mm. ^mw^t^^m^mtvxmmirx^Kirtii^xw ^hiat. Atfy^^:^h 
:xm7f)K ^^m^^^^^mmvxnhtitL^^mmi^^xhV)^ ^^^^^^^^^^^^ 

^^mi^<^—:^y(Dx^fj:mm^^^xx\\ mmi^. A^h'r^^h^mTfiK mjcm 
^ocmc^mr^^ticx-:>xm'htifcjc^mm^^x^^m^ia^. <^n>(Dx^fj: 

mm^'T^:^h:Xm^(DM!t^ir^m^^ibXX\^ \ 

[0023] /^:ib\ m'B(DMMX(Dmm^m(^^^^'7J^, unigram)(Dft^«9(;i. ^^"T^^McO 
2-Dm.(^^4i^yJ^, bigram), SomCh^-T^^^A, trigram), $^>(;i— ^S^/c^n^iia 

(.n-gram)^—m<Dmmtmx.x. ^(Dmm^T^:^hmwMio2Kmmvxhx\\ m 

1 2 2 3 T-1 T 

[0025] :^MMMXl^. ^■T'/V^^^tL-^/V=':7^^>V(Hidden Markov Model^fc{*HMM)<i: 

u fj:^^^-D^<Dmm^—:ff\^m(\eft-to-nghtm)x\ mM±^<7)A:fdmmmi^ 
^~^ti^m-m(Dmmmmmtir:6o Left-to-rightMHMM-e«. y—h^(DWc^mmir 
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[0026] ^^-r/v^^SBlOSf*. A:fjT^:^hXmK\^ Ko(D|gM^5-^mTV ^^t^cit^]:. 

min 

max 

206, 207) o ^'-tf^T'/V^^j^fe-r^i!}*. ^T'/V^^S-r^^-^^^— i?'(^'fit^tB'g 

. wc\M.mi.^^(o^mt^}^(Dmmicmrt^t)^\c^-^x. \t)^h\^^x(om&}i^Wb 

[0028] ^■t'Vw-?^^*— ^^^>fbg|S104{*, 'IK^7'>V^^!^$P103;a5^^!febfci-^TO^'7'>V 

i?'^. _h^(7)left-to-rightMili5:HMMCD#^. a , a 

2 N l,j 2,j N,j 

j=i, 2, -, L T% LfiA;^7^=¥>^h:ic«l;i'^^tv5mM<^«sm. 

i i 

J:o-c. it^MipO^^SSt't^if-M^flfe^fii-airJfe^o |B-^m;OII*b 

tt^mts-^fi^m^x^^. 'r^x(Dm&i^h 2, N^^:*5v^-c. fB-^m^m*<^^^ 
fpb +b +-"+b }ii-e/^fmf^/^^)/^v\ 

i,l 1,2 

i i,j 
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[0030] ^t'Vw?^^— i5^iis§i5io5}*. ^7^/w<yy^—i^^m^tmo4Kx-oxwm^t^n 

1 2 

T 

ri995^11^ , NTTTh^M:y:^T^ytii^m^^^±. ^^f^i—mm. # 

i iJ t 

(i)*5j;TOfR]#^#:^ (im=l. 2, T. i=l, 2. NfC;bfcoTtf#U 

t 

ij 

[0031] [M 

«i (0 = ^1.0, ^1.,- . (0 = ^/-i^-.o, 0 - 1) + (l - (0. ... (2) 

(/) = aj^S^^i , (i) = (1 - a, A+i (0 + ^i^M,o,,, Pt^i + 1> 

[0032] [M 

r-i 

-(3) 

[0033] ^T'/v^-^^^-^tiSfPiosi^Sott^^-^^T^— i5'«^(^K«f+^<^ilx:*:¥iJ^^fT5 

i)^^htifj:<fM^. ^(DmuxRm$YW^mrirti\^x\^\ rr-r% ±m\'iaa) 
j3 a)i!bT#^>tb^„ ^^>w-?^^— ^ti^§i5io5{*. Rmn]-w^mrr\^fcmux\ 
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iJ'a.b tufR]#*5j;U?^fB]#^^a (i), i3 (i)^. ^^XHMM)(D 

i ij t t 

[0034] ^7^>M4R§i5io7f*. ^y'/w^yp^—^mmmod'^^mwc^tKmhnfc^^^?^— 

(^#*ft#*^2p(AIC(Akaike's Information Criterion))-^ft/jN|E]^;RS^P 
(MDL(Minimum Description Length)^^p)/ce^'^cl^<5V^Ttf-^i-^i^:55■t?^;5o # 

;a/J^tB5zE;ft»f^oVNT{*. f?!l;t{^r 1994^12^ . ^^mf^. 

mmmmwc^iMmi']. m^mmm. tt m249-275Mj (jcms 

) tiiiBft^sa^;^^ '^Jx.f^AIc^;lJ;^^f^. ^<'^?i—^mmuM'^<DMmi±m. logCa a) 

J:tbf^. jffMe^^i. >Pf»±it^^f -^MSibf^ -log(a a) )3 a))^. 

[0035] 7^dr;^h^fijf^;^m;^§i5io8{i. ^v'/vmumoncx-Dxmu:^tifc:\kmm<D 

5/:/209)o 

1 2 T 

hisc^tt^cD^^o ;$s^i#S(DfgMEF^f-#j>9^^T^>;h.»^^^i-o mnm^j^^m 

t 

P( z=i I o , o , o ) 7!)^^M::ktfj:^i^^l, 2, T (3::bfcoT^J?)5r^ 

t 1 2 T 

[0036] [m4] 
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P(., =/h,o,,-,o,)=^,^ML ...(4) 

[0037] fj:^. rrTi*^'7'>w-?^p<-^*i^§|5i05«. v ( 

(MAP(Maximum A Posteriori)ti^)^fflV^;5'^tj-e^^o ;^:^*#ffll^ti^t^oV^ 

-^[Ix-f^ ri995^ii^ . NTTTHv^^;^7"i^ynv?t5fe^^i±. 

miR. #™ii(^s«g(T). ^i66-i69Mj (Jc^e) icmm^^h^o ^±^mmm 

i 

*tU^*f*^— log p( a I K , K ) = ( K -1) X log (1- a) + ( K -1) X log (a) 

i 0 1 0 i 1 i 

+ const, b <D^>(\H^^^^U^U^^ log p( b , b , b | X , 1 , X ) = {X 

ij i,l i,2 i,L 1 2 L 1 

-Dxlog (b ) + (X -Dxiog (b ) + ••• + (;i -Dxiog (b ) + const tm^ti^o fcfd 

i,l 2 i,2 L i,L 

0 112 L 

[0038] [^5] 

r-i 

"i r-1 r-1 ' 

2^ a, - a, J3,^, if) + ATo - 1 + S (0«,-^+i.o, + 1) + ft^i - 1 

-(5) 

h^'r z • 

S«,(0a(0+E(4-i) 

[0039] ;fe*D. rr*T'-exl-<fc;^IIJfe^Jfe:*5V >Tf*. IE-^tti;f7ffll*b ;$5jt^^i:^j^^#{t^ 

ij 
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i^'otmm(Dm\^mmi^m^ir^x^Km'^mtimm^m^i^x:^iirit.^m^M 

[0040] ^2(D'MMM 

m^. ^mm(Dm2(Dmm,m\^^\^x^ mm^mvxnm\mmir^o 
i-^7^=3r>^MBi»$i5io2^. 'T^::^vxm(Dmm(Dm^^mvtr^^f7vxhox. t 

i\:Mim^^-oXmmit-^fhf^'e'f/vt'T^:y^VW0.^ 

^ti^§l3i05;^stfofc/-?^^-^ti^(D|^^^1#lrti-§*ifel^:^tBlt $13106^. 

'^m^mMimmM^<D^'f;v(D^<y?^—^mw^m>^Wi^^fhx\^^m^\^^ 
T*§;^^m^-r^^dr;^h5^f'j*§;^my^;§pio8^«x.^o ^^(Dm-i. ^tv^w+m 

[0042] ^{ci. ;^^ii0r|<3oii]f^f;iov ^T. )ii^iioTffc5gi-6o 

[0043] 7^^;^hAy^f|510K 7^=3r^htEll§|5102*5<J;i;^^^^>^^g|3103f*. -^rtv^^tv^ 



wo 2005/069158 



13 



PCT/JP2005/000461 



tmM. left-to-rightMilt5cHMM-efc§/5S, $bf^i5'^K5:i^;^5^-V(tied-mixture)HMM 

IJ 2,j 

b (Dm^^^c b + c b +---C b -efe«9.b (Dmi-i^^Ml^i^fc-oX^mtir^b 

M,j i,l l,j i,2 2,j i,M M,j i,j 

ov^Tf*. -^(Ix-fi ri995^ii^ , NTTTHv^^;^7"i^ynv^^^^'ii. ^tf-^— ftll^^ 

w^mi^(^sfii(T). ^28o-28imj (:xm7) Kmmi!)^h^o ^^K^i^;=^ 

i 

tB^my^#*b . ^xnm^-mtimm^Mir^m^w^c xh^o ^^x\ i^ix-- 

j,k iJ 

.N-e. Ni^'JikmWcxh^o j=i,2,-,M-e. Mi^mm(Dmm^ k=i, 2, l -e. l 

mait. mi(7)mmmtmm. ^ma^h^mi+ucm^ir^mmxh^o m'B-mtim 
mh HSMj^-*5v^T. 4^^'f^:^kxm^^ti^^m:d^m±i^th^mmxh^o * 

j,k 

j,l j,2 j,L 

c +c +---+C ■hlXfj:iftmtf:h^j:\\ 

i,l i,2 i,L 

[0045] ^v'/W^V^^—^WMitMlOAit^ ^mMN(D^T^MzMVX. mK.i-f±7^(D^^< 

i j,k i,j 

[0046] ^^Vw?^^— ^*i^§|3i05«. ^f^v-^^^^^—^^Mih^iOAicx^xi^mit^ti 
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1 2 

T 

1 j,k i,j 

mit^Kx^xm\^tmma (o^xu^^i^^mm^ (im=i, 2, t. i=i, 2, 

t t 
/^tHlfctx^<«9Mi-o fcfcbrrt^ 6 (4^n^.-/;^7— (DT'/Vi?'. i^jf^hl. 

ij 

[0047] [me] 

J=i M ...(6) 

[0048] [m?] 

S S ^yt'^M.j^j.o, A+i (i + 0 
^ ^ t=i j=i 

E Z (0(1 - hjbj^, A+i (0 + (^" + 1)} 

E Z K (0(1 - >,v6y.o, A.I 0") + ^Ol./y.o, A+1 ('■ + 1)} 

E Z E k (^'Xi - «i. h'jbj^j^t.^ 0-)+ 0-'+i)} 

i=l i=i A=i 

X {a, (0(1 - a, hjbj,o, A^i (0 + «r (f)^i^Mjbj,o, Pt.x 0 + O} 

C 4r-^ £=1 . 

EE F« (0(1 - «iK/^/.o, A.i(0+ «r ^WM.fbr,oA*Ai + 01 

[0049] ^7^>W-?9^-i?^«^$|3105(3:*5(t§^^7^--^m^(^S«f+^<^t|Jl:^¥lJ^^fT5 

1 

i3 a)^b-c#e>ti.§o ^*i^$pio5{*. mM^%^m^\j-dm^x^ 
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iJ'a. b . c m\^^^XXJ^^\^^^WCa (i). jS (i)^. ^T'MHMM) 

I i,j t t 

[0050] ^7^>M4R§i5io7f*. m<Dmmmtmm. "^e^/w^yp^—^mmmod-^iikmmi 

[0051] ^=ar;^h^fiJ|gmt±l;OlF|5108f*. ^l(75||Ji0iJf;i*5{tS^=ar;^h^fiJ|g^t±l;OlF|51O8 
m^^i~i. ^(4) l;itJ§oT. P( z=i I o , o , o ) ■^m±t^J:^m=h 2, T K 

t 1 2 T 

[0052] /^:}o, ^-T^vw-^^p?— i57ti^gi5io5«. mK^Mmw^itrnm. M:±m^m(Di^^m^ 
m±w^mmmm(MApmmmi^x^x^'f/i-^<9?^—^^mm\^x-hx\\ 

[0053] ^3<D||Jg^J 

^mm(7)m3(DmmmK-^\^x. mm^mm^xmmir^o 

^^^i-6^^^>V^^lfP103^. '^^^>V^^f|3103;as^^b/c#^7^>V^mS 
^^y:^—^^n\\:M\mz.^<>x^m\\:.-^^fz.'^'f;vh'T^ 
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[0055] m^. ^mmm(Dmm^-:>\ ^x. m^Tt-oxmrn-r^o 

[0056] 7"dr;?^hA;^§BiOK 'T^:^hmmUi02i3XUU^'T/^^mmozit. ^fh^fiX 

i: XlU^'f/v^j^n^ 103^ m—(Dm\¥^'r^o 'T^:^Vt^mm2 mKts'T^:^V^ 

^(DMmmm^m^mmir^^tx\ mmmti.xm^^t^^x^^^tti:t^h. 

[0057] ^T^/W<9?^—^^m4t^l0m. '^^7=VV^^$|3103^S>^^bfcm— *fc{«#C 

i 

ij 

i 

m'^mtimm <D^^t\.x. ^ti^ti^-^^^ log pc a u , k ) = ( k -d 

ij i 0,i l,i 0,i 

Xlog(l-a) + (K -Dxlog (a) + const, t'VV^:^!^^* log p( b ,b , b \X 

i l,i i i,l i,2 i,L i,l 

,X ,"',X ) = -l)Xlog(b ) + -l)xlog(b )+••• + (1 -l)Xlog(b ) 

i,2 i,L i,l i,l i,2 i,2 i,L i,L 

0,i l,i i,j 

0,i 0 l,i 1 ij 0 

fdl^K = s (1-N/T) +1, AC = £ N/T+1, X = E /L+1. t\^^X^lC^^^<9?^—^^WM 

0 1 0 
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[0058] ^^>Wn^^— iJ'Ji^flSlOSfi. ^'T7i^^<9?^—^i^mi\:.^ioAizx<:>x^mi\:^th 

1 2 

T 

i-f^i^-h. -^[J^tf^ r2002^7^ , m^ff Mm^^ife. ^85^, ^7^, ^504-509 

0,i l,i i,j 

^b^f;ij;oTttffB]#^#:a (\mxx:^^\^^^m & (im=i. 2, t. i=i, 2. n 

t t 

ij 

jfe^i. ■e^-e^'^itttf^o^ir^o ¥(x)=d( log r(x) )/dx -c\ r(x){*;^f>'-^g|^ 



[0059] [#C8] 



a,(0=exp(5,,^X,, 

«f (0= - l)exp{/4,,M + )+ a,_i(i)exp(^o,/ + ) 

A (0= A+i(OexpU^. + )+ A^iO' + l)exp(4., + 5,^,,,^^, ) 

ft ^ 



(8) 
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r-i T-] T-] 

/=! t=l /-I 

— „ a,(OA(0 

S«<C/)A(/) 

/=> 

/=! j={0,l} 
J=1*={0.1} 

[0061] ^^>W-?77f— ^ti^tP105(^*5tt§^-?7P<— ^*i^(7)^«f+^(7)i|Ji:^ii^lJ^(^, J£ 

0,i l,i i,j 

t t 

[0062] ^■t'Vv^-?^^^— ^m^§|5105l^*5(t§^^^-?^p«— ^(D-<-rXtife)5fei:LT«. 

[0063] ^T^WMiRSRioTf*. ^Tyw<y^—^m^mo5-x?^mm^ticnhtifc^<9?i— 

-<-rxe<j^!p{*^(io)-etf^BrigT'fe§o ^(lo) k^^x kn) f*H^^#:-r 
^^^mftii^. p(N) fi— sffi-ej;v\ mi^. w&(D^mm^m:L'o^'r\\ 
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0,i 

, X tfrfR]#*5j;u?mfB]#^m a (i). & (i) tvxn^ ^mm^\z.n^^ir^^(D^ 

l,i i,j t t 

[0064] [^10] 



N 



r(K-o+^r,) r(fro,,.y(?rj,.) 



(10) 



[0065] ^dr;^h^fiJ*g^mv^7§R108}*. lLii^(D%\^^XJW,2.(DmMm\C^\^^y'^:^V:^ 

fiJ*^mm;^lfPi08t[^«. ^■7^VvS^lf|5i07t^<J;o-CB4R$tLfcit^S#ci-^^t>*>Sg 
smN(D^7^>vi;i^j^i;i-;5^^/w-^^^— i5^*i:e5^m^*i^lt;^fBlt§pi06;5^b^ 

-r^o :^l#l5^^^5>*'Jl^mf*^ 5^(4) i^l^^oT. P( z=i I o , o , o ) ii^^i^hfSi^x 

t 1 2 T 

^t=i, 2, T f;i;bfcoT^je)§^^-e#btL§o 

[0066] 7^*5, ;^|lii^J-et>. _hi&bfc^2(D|lii^Ji!lKl#^ ai'<7)left-to-rightMHMM<7) 
ftt>«9f3:, ^>rK5:i5^^^^(tied-mixtureM(01eft-to-rightMHMM^^^. 1?]*!^^^ 

/w?^p<-i5^^i^§Pl05^■^^^■etl^^i-;5r^;65Rrtg-efeSo 

[0067] ^4(D||Jfe^[I 

[0068] IE|4^#Mi-§^^ ifm^n(r)W,A(DW^m\i~. y^^y^V^Mzfn^'yJ^&^^m'mU-^ 
ia^lK#:601^#X.6„ r<D|B^IK#:601f*CD-ROM. ^^^T^VJ^^iJ^. ^^^7<^y-?: 
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^T^VWn^^— i57|OSi^b§|5104, ^7^>Wn7P<— ^*i^§|5105, ^T^/VSiR^PlOT, T 

^::^h^mi^^mt}mo8Kx^mmtm-(Dmm^mn\^x. mi. m2. ^>\^<itm 
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[3] mMmKmm(DT^:^hmm:^mi^^\^^x. 

[6] tt^^l^3:fB^(D7"dr^hMS;^&^i*5V^T. 
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